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Abstract 

Loveland comple xitv lLovelandl |l96i) is a variant of Kolmogorov complexity, where it 
is asked to output separately the bits of the desired string, instead of the string itself. 
Similarly to the resource-bounded Kolmogorov sets we define Loveland sets. 

We highlight a structural connection between resource-bounded Loveland sets and 
some advice complexity classes. 

This structural connection enables us to map to ad vice complexity cl asses some 
properties of Kolmogorov sets first noti ced by Hartma nis iHartmanii (| 19831 ) and thor- 
oughly investigated in Longpre's thesis llTongprel (|l986l ): 

1. Non- inclusion properties of Loveland sets result in hierarchy properties on the 
corresponding advice complexity classes; 

2. Immunity properties of Loveland sets result in the non-existence of natural 
proofs between the corresponding advice compl exity classes, in the sense of 
Razborov & Rudich [Razborov and RudichI l|l99 it l. 



1 Introduction 

Kolmogorov complexity is a measure of algorithmic randomness. If we consider 
words of length n over the boolean alphabet S = {0, 1}, then KS {x) is defined 
to be the length of the smallest input enabling a given universal Turing machine 
U to output X. It is possible to "hide" x in the input, so KS (x) < I {x) + O (1) 
(where I (x) is the length of x). Since there are 2" — 1 words in S-""-'^ but 2" 
words in E", by the pigeonhole principle, at least one word of length n cannot 
be output with a smaller input. Such a word is called incompressible. Numerous 
applications of this result, k nown as the Incompre ssibility Method are given in 
the textbook of Li & Vitanvi FLi and Vitanvi llooi). The same argument shows 



that almost all words are almost i ncompress i ble. 

The Shannon-Lupanov theorem lShannon (Il949l) :l iLupano ^ (Il958h states that 



any boolean function on n variables can be computed by a circuit of size at 
most ^ (1 + o (1)). This bound is tight; moreover almost all boolean functions 
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have almost this complexity. Trakthenbrot TrakhtenbrotI ( 19841 ) drew a parallel 



between boolean functions having a circuit complexity of at least (1 — e) ^ and 
words such that KS{x) > (1 —e)l{x). Such an analogy suggests that there 
may be a connection between hard boolean functions and incompressible words. 

Indeed, Karp & Lipton noticed that languages in P/log could be computed 
by "small circuits with easy descriptions". Look i ng for some kind of reciprocal, 



Hermo & Mayordomo iHermo and Mavordomo (11994 gave a nice character! 



zation of the advice complexity class P/log in terms of the resource-bounded 
Kolmogorov complexity of its circuits. Assuming that t (n) and s [n) are con- 
structible functions, a sequence of words {xn) of length n belongs to the Kol- 
mogorov set KS [f (n) , t (n) , s (n) \y (n)] iff for each integer n, Xn is computable 
by the universal Turing machine U with an input of length at most / (n) in 
time t (n) , in space s (n) and with knowledge of some word y (n) . Using the 
P-completeness of the Circuit Value Problem, they proved that P/log is the set 
of languages decidable by circuits belonging to KS [O (logn) , poly (n) , +00 |n] 
or, equivalently, by circuits belonging to KS \0 (logn) , +00, O (logn) \n \. 

Building on Hartmanis iHartmanid ( 19831 ). Longpre iLongpr^ (198a) stated 



many structural properties of the above Kolmogorov sets. However, the char- 
acterization of Hermo & Mayordomo does not make it possible to map the 
properties of the Kolmogorov sets to the advice complexity classes, since sev- 
eral different circuits may compute the same function and not all words encode 
circuits. To do so one needs a more narrow approach. 

The purpose of the present work is to provide a characterization of some 
advice complexity classes by Kolmogorov sets enabling to map some of the 
properties of the latter to the former: 

1. Non-inclusion properties of Kolmogorov sets result in hierarchies proper- 
ties on the corresponding advice complexity classes; 

2. Immunity properties of Kolmogorov sets result in the non-existence of 
natural proofs between the corr esponding advice complexity classes, in 



the sense of Razborov & Rudich Razborov and Rudich ( 199 



ity I 



In a breakthrough paper iRazborov and RudichI (|l997n . Razborov & Rudich 



identified some properties shared by all known proofs of lower bounds on the 
non-monotone circuit complexity of some individual boolean functions, which 
they called natural properties, and showed that such properties would not be suf- 
ficient to derive superpolynomial lower bounds for circuits (with some hardness 
assumption) . 

We believe that Kolmogorov sets are a convenient substitute for diagonal- 
ization, since they are more compact and explicit. In particular, the results 
presented in this paper may be viewed as resulting from diagonalization. 
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2 Connection between Kolmogorov Sets and Advice 
Complexity Classes 

2.1 Framework 

Kolmogorov-Loveland Complexity. To make the connection as clear as possi- 
ble we do no t use simp l e Kol mogorov complexity KS but a variant introduced 
by Loveland iLovelandl ( 1969! ) called d ecision Kolmogorov c omple xity {KD) in 



the classification of Uspensky & S hen iUspensky and ShenI (|1996( ). and also re- 
ferred to as uniform complexity in iLi and Vitanvil l|l997[) . In this variant, the 
universal Turing machine U is not required to output the word x but to give 
X [i] (the i"^ bit of x) upon request. The input of U consists thus in a self- 
delimited tuple (p, i, y) where p is the actual input, i is the number of the asked 
bit of a;, and y is a word given for free as an auxiliary input. We take as usual 
(a, h) = l'('^)0a6 and (a, 6, c) = ((a, 6) , c). 



Kolmogorov-Loveland Sets. In the setting of Kolmogorov-Loveland complex- 
ity, the required output is a single bit, so it does not make sense to measure 
time and space with respect to the output. Instead we are going to measure 
them with respect to the input. This will allow a simpler connection with 
advice complexity classes. So we say that a sequence of words a;„ of length 
n belongs to KD [/ (n) , t [u) , s (u) \y (n)] iff for each integer n there exists a 
program p (n) of length at most / (n) such that for all i between and n — 1, 
U {{p (n) ,i,y (n))) — x [i] and the computation is done in time at most t {u) and 
in space at most s [u). where u = I {{p (n) , y {n))). The choice of u may seem 
rather strange at first glance, but we choose this definition so that the connection 
with advice complexity classes may be as simple as possible. Moreover bounding 
resources with respect to input size makes this complexity prefix-monotonic, in 
the sense that the program p and the word y used for a word x in time t {u) and 
in space s [u) can also be used for all of x's prefixes. 



Advice Complexity Classes. The advice complexity classes we are going to 
consider are of the form DTISP [t {u) , s [u]) / f (n). Given two fully time and 
space constructible functions t{u) and s(m), a language L over the alphabet 
E = {0, 1} is in DTISP {t (u) , s (u)) iff there exists a Turing machine deciding 
it in time 0{t{u)) and in space 0{s{u)). Now the advice complexity classes 
are defined as follows: let C be a complexity class. L £ C/ f (n) iff there exists a 
language L' in C such that for all integer n, there exists a word u;„ (the advice) 
of length at most / (n) such that for any word x of length n, x Cz L 

{Wn, X) e L'. 



Characteristic Words Sequence of a Language. Given a language L, we con- 
sider its characteristic words sequence, defined as follows. First we recall that 
a word x of length n over the alphabet S can be considered (in the binary 
numeral system) as an integer int (x) between and 2" — 1. We denote the 
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inverse function from integers to words as word„ («). Note that word„ (i) will 
have length n and may begin by a sequence of zeros. In particular the word 0" 
corresponds to the integer and the word 1" to the integer 2" — 1 (keep this 
in mind) . Now the characteristic word of the language L for length n is a word 
of length N = 2" defined by L„ [i] — lwoid„(i)ei (i-*^- 1 word„ (i) G L and 
otherwise). 



2.2 Connection Lemma 

Lemma 1. Let f{n), t{u) and s{u) he integer functions such that tiu) and 
s (u) are non- decreasing and fully time and space constructihle, t {u) > u and 
s (u) > log u: 

1. if L e DTISP{t{u) ,s{u)) / J {n), then (L„) G 
KD [f (logiV) + 0{\),0{t {u)\ogt{u)) , O {s (u)) jl'^sA'] 

2. if (L„) e KD[f (log N) ,t{u) ,s{u)\l^°e'^], then L e 
DTI S Pit (u),s(u))//(n). 

Proof. The main idea is to switch from integers to strings of a given length and 
vice- versa. 

1. if L e DTISP (t (u) , s (u)) // (n), then there exists a language L' decided 
by a Turing machine M' in time O (t (u)) and in space O (s (u)) such that 
for all integer n, there exists an advice word Wn of length at most / (n) 
such that X € L {wn,x) e L'. Now consider the Turing machine M 

which on input {p, i, y) computes n = I (y) and x = 0"~'^'^i, and simulates 
Af on {p,x). By construction, M (wn,i,y) — [i] and M runs in time 
O {u + t (u)) = 0(t {u)) and in space O (log-u + s [u)) — O [s [u)). Now 
M can be simulated by the universal Turing machine U (which has a fixed 
number of tapes) in time O {t (u) log t (u)) ar id in space 0(s(u)) thanks to 
the simulation method of Hennie & Stearns Hennie and Stearnsl 1 19661 ). 



2. if (L„) e KD [f (logiV) , i (w) , s (u) |li°g^] , then for ah integer n, there 
exists a program p„ of length at most / (n) such that for all integer i 
between 1 and N, U {pn,i,y') = Ln [i]- Now p„ can be used as an ad- 
vice, as follows: consider the Turing machine M which on input {w, x) 
computes n — I (x), i = x without the inital zeros, and simulates U on 
Then M{pn,x) = IxeL and this computation is done in time 
O {u + t (u)) — O {t (u)) and in space O (logu -I- s (u)) = O {s (u)). 

□ 



3 Transfer of Properties 

We are going to use the above Connection Lemma to transfer properties of 
Loveland sets to the corresponding advice complexity classes: 
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1. Non-inclusion properties of Loveland sets result in hierarchy properties on 
the corresponding advice complexity classes; 

2. Immunity properties of Loveland sets result in the non-existence of natural 
proofs between the corresponding advice complexity classes. 

So we shall first establish the properties of Loveland sets. They are very similar 
to the properties established by Longpre in his thesis, but we must revisit them 
because we work with Loveland complexity instead of standard Kolmogorov 
complexity, and moreover we measure the resources with respect to the input 
instead of the output. 



3.1 Non-Inclusions and Hierarchies 
3.1.1 Sensitivity to Advice Length. 

The foll o wing proposition is analogous to corollary 3.2 of Longpre's thesis 
Longprel ( 19861 ). Here the proof is simpler because KD is prefix- monotonic. 



Proposition 2. // / (n) < n, then there exists a constant c such that for all 
y (n) we have 

KD [f (n) + c, cu log u,c log u\y (n)] ^ KD [f [n) , +oo, +oo\y (n)] . 

Proof. By counting, there exists some x of length / (n) -|- 1 incompress- 
ible with respect to y (n); by prefix-monotonicity, z ~ a;0"^-^'^"^^^ ^ 
KD[f (n) ,+oo,+oo\y{n)]. Now the program which on input {x,i,y) prints 
x[i] if i < I (x) and otherwise, has length / (n) + 0(1), works in time 
O {I (x) -I- I (y)) and in space O (logZ {x)). As above, this program can be sim- 
ulated by U in time O (ulogu) and in space O (logu), where u = I {{x,y)). So 
there exists a constant c such that z e KD [f (n) -|- c, culogu, clogu\y (n)]. □ 

Now using this proposition together with our Connection Lemma yields the 



following result, which was already present in lHermo and Mavordomd (| 19941) in 



a similar form. We denote by REC the class of recursive languages. 

Theorem 3. Let f (n) and g (n) be two integer functions such that f (n) + 
I (n) < 2" and g {n) is non- decreasing and unbounded. Then 

DTISP {u log u, log u) I if (n) + g (n)) <^ REC/f (n) . 

Proof. By proposition [2] and the fact that g (n) is non-decreasing and un- 
bounded, we consider a sequence of words L„ of length N = 2" belonging to 
KD [if + g) (logTV) , culogu, clog u I li°s^] \KD [(/ + f ) (log TV) , -hoo, -Hoo|li°s^] 
for some c and for n large enough. Now by the above Connection Lemma, the 
corresponding language L is in DTISP (ulogu, logu) / (/ (n) + g (n)). Suppose 
by contradiction that L g REC/ f (n). By the Connection Lemma, there exists a 
constant c' such that {Ln) ism KD [/ (log A^) -I- c', -l-oo, -|-cx)|l'°s^j . For n large 
enough, g (n) > 2c' and then (L„) is in KD [(/ + f ) (log TV) , +oo, +oo|l'°s^] , 
a contradiction. □ 
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3.1.2 Sensitivity to Time and Space. 

We give a pro position analogous to theorems 4.3 and 4.4 of Longpre's thesis 
Longprd(|l986l ). The main difference here is that we consider that resources are 



bounded with respect to the input rather than the output. 

Proposition 4. Let f{n), t{u) and s (u) he integer non- decreasing 
and constructihle functions such that f (n) < n, t (u) > u and 
s (u) > logu. Then there exists some constant c such that if 
t'iu) > c2-^(2")j(2«)t(2/(2")+u)(/(2") + logi(2/(2«)+M)) and s' (u) > 
c (2-''(2")/ (2«) + s (2/ (2") + u)), for n large enough, 

KD [c, t' {u) , s {u) |n - 1] ^ KD [f {n) ,t{u),s (u) \n ~ 1] . 

Proof. By counting, there must exist some x of length / (n) + 1 incompressible 
with respect to n — 1 in time t(u) and in space s (u); by prefix- monotonicity, 
z = xO"-~^^"^~^ ^ KD [f (n) ,t{u) ,s {u) |n - 1]. Finding the smallest such x in 
the lexicographic order can be performed by exhaustive search by running all 
programs of length at most / (n) in time t (u) and in space s {u). Here we face 
a trade-off between time and space: if we choose to store all generated strings 
to avoid recomputations, this increases the required space; otherwise we may 
iterate the exhaustive search for each string of length / (n) + 1 until we find the 
desired one. The first option takes: 

• an overall advice of length O (1) (since n — 1 is given for free); 

• an overall time of O {2^^"'^ f (n) t {2f (n) + \ogn + 2)) , since l{{a,b)) = 
21 {a) + l (6) -1-1 and I (n - 1) < log n -1-1; now u = / ((p, n - 1)) > logn-|-l. 
So the time bound is O {2f^'^^'^f (2") t (2/ (2") + u)). Again there is an 
extra logarithmic factor due to the simulation by our fixed machine U ; 

• an overall space of 0(2/(")/(n) + s(2/(n)+logn + 2)), i.e. 
0(2/(2")/(2»)+s(2/(2") 

□ 

Now using this proposition together with our Connection Lemma yields the 
following result. 

Theorem 5. Let f{n), g{n), t{u) and s (u) be integer non- decreasing and 
constructihle functions such that f (n) + g (n) < 2"' , g is unbounded, t (u) > u 
and s (u) > logu. Let t" (u) and s" (u) be such that t" [u) — u {t (u) logi (u)) 
and s" (u) = uj [s {u)). Then there exists some constant c such that if t' (u) > 
c2(f+9)M (/ + g) («) t" (2 (/ + g) [u) + u) ((/ + g) {u) + \ogt" (2 (/ + g) {u) + u)) 
and s' (u) > c (2^f+9)M (/ + g) {u) + s" (2 (/ + g) {u) + u)) , then 



DTISP it' {u) , s' in)) /c ^ DTLSP {t (u) , s [u]) // (n) 
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Proof. By proposition HI we consider a sequence 

of words Ln of length = 2" belonging to 

KD [c,t' (u) ,s' (u) \KD [if + g) (log N),t" (u) , s" (u) |li°s^] for some 

c and for n large enough. Now by the Connection Lemma, the corresponding 
language L is in DTI SP [t' {u) , s' [u)) / c. Suppose by contradiction that 
L G DTISP {t (u) ,s(u)) / f (n). By the Connection Lemma, there exists a con- 
stant c' such that (Ln) is in KD [f (logiV) + c', c't (u) logt{u) , c's (u) \l^°eNj . 
For n large enough, (/ + .g) (log iV) > /(logiV) + c', t" (u) > c't {u)logt{u) 
and s" (u) > c's (u), so (L„) is in KD [(/ + g) (logiV) , (m) , s" (u) , a 

contradiction. □ 



3.2 Immunity and Natural Proofs 
3.2.1 Immunity of Kolmogorov Sets. 

Immunity is an indication that a language is algorithmically very complex, in 
the sense that given a complexity class C, a language L is called C-immune iff L 
is infinite and does not have any infinite subset belonging to C To this we add 
the notion of density: a language L has partial density S iff there exist infinitely 
many n's such that L contains at least 6 (n) 2" words of length n. Thus we 
generalize the notion of immunity using density: we say that a language L is 
C-immune for partial density (5 iff L is infinite and does not have any infinite 
subset of partial density at least 6 belonging to C. 

As noted by Hartmanis iHartmanisI (1983) and further developed by Longpre 



Longprd (|l986h . the complements of Kolmogorov set s are immune. Longpre's 



results for immunity (theorems 3.7, 3.8 and 4.13 of iLongpri ( 19861 )) concern 



classical complexity classes and global density. Here we deal with advice com- 
plexity classes and partial density, as follows. 

Proposition 6. Let f{n), g{n), t{u) and s (u) be integer non- decreasing 
and constructible functions, such that f (n) < n, g [n) is unbounded and 
g (n) < f{n). Let 6 [n) be a function to the real interval [0,1] and p{n) = 
(1 — i5(n))2" + 1. If t' (u) > u and s' (u) > u are non- decreasing, t' (u) = 

o ( p(u)iog(p°Hta°g^')) ) "■'"^ ^' ^""^^ ^^'''^ 

S*\ U„Giv KD [f (n) ,t{u),s [u) \n - 1] is DTISP it' (u) , s' (u)) / (f - g) (n) 
immune for partial density S. 

Proof. Let us consider any infinite language A G 
DTISP (f (u) ,s' (u)) / if - g){n) with partial density 6. We argue that 
for n large enough, the lexicographically smallest word of length n belonging 
to A is in KD [f {n) , t (u) , s (u) \n — 1]. Indeed there exists a Turing machine 
M working in time t' (u) and in space s' (u), and a sequence of advice (wn) of 
length I (wn) < if - g) (n) such that for all x G E", x G A -^=> M {wn,x) = 1. 
Thus it suffices to simulate M with advice Wn on all a;'s of length n in the 
lexicographic order. 

• This can be done by a program of length (/ — g) (n) + O (1) (since n — 1 
is given for free). 
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• For an n such that A contains at least S (n) 2" words of length n, there 
are at most (1 — (5 (n)) 2" + 1 = p{n) steps of simulation, each step 
requiring a time t' {v) where v = ? 1")) < 2l{wn) + n + \ < 
22K'"„)+iog(n-i)+i ^ 2'«'^"'"-i» = 2". The simulation by our universal 
Turing machine U can thus be performed in time O {{pt' log {pt')) (2")) = 

O ( log(p(2")«(n)) log log(p(2")nn)) ) • Si'^Ce < t (^) < P (2") i {Ul 

this is o (m)). 

• The above simulation can be performed in space O {v -\- s' [v)) = 
0{s'{2-))^o{s{u)). 

□ 



3.2.2 Non-Existence of Natural Proofs among Advice Complexity Classes. 

We first recall the definitions of Razborov and Rudich ( 19971) (section 2.2). A 



combinatorial property is a set of boolean functions. Each of the 2^ boolean 
functions on 7i-bit inputs can be described by a binary word of length 2" (which 
in turn can be seen as the characteristic word of a language, see section 12.11 
above) . Thus a combinatorial property can be seen as a language with words of 
length powers of 2. The question whether a given boolean function belongs to a 
combinatorial property is an algorithmic problem which requires some time and 
space depending on the length 2" of the boolean functions. Thus it is possible to 
group together combinatorial properties with respect to this algorithmic com- 
plexity, and such sets of combinatorial properties are some kinds of complexity 
classes. These complexity classes should not be confused with the complexity 
classes of the boolean functions themselves, i.e. the time and space (depending 
on n) required to compute the boolean functions on n-bit inputs! 

Given a complexity class C, a combinatorial property T is called C -natural 
for partial density 6 iff there exists S C F such that: 

constructibility: S G C 

largeness: S is infinite and has partial density S o log (since the words in S have 
lengths of the form 2") 



In fact the density considered in iRazborov and RudichI (|l99l1) is global, but we 



refine it to use partial density. So, what does a non-natural property look like? 
It is a property without any large constructible sub-property. This looks very 
much like the aforementioned notion of immunity. Indeed: 

Remark 7. Let F be a combinatorial property, C a complexity class and (5 : TV — >■ 
[0, 1]. Then F is not C-natural for partial density (5 iff F is C-immunc for partial 
density S o log. 

Now what is the use of a combinatorial property? Given a complexity class 
T), an infinite combinatorial property F is called useful against 2? iff 

usefulness: given a sequence (L„) of characteristic words, if i„ G F infinitely 
often then L ^ V. 
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Why is it called "usefulness"? Because in order to prove that L ^ T>, it is 
enough to prove that I/„ G T infinitely often. So Razborov & Rudich manage to 
prove that for various circuit complexity classes C and P there are no C-natural 
properties against V. Using proposition [5] together with our Connection lemma, 
we prove the following result: 

Theorem 8. Let f{n), g{n), t(u) and s (u) be integer non- decreasing and 
constructible functions, such that f (n) <2^ , g is unbounded and g (n) < / (n). 
Let 8 (n) be a function to the real interval [0, 1] and p [n) = [1 — 5 (logn)) 2" + l. 

If t' (u) > u and s' {u) > u are non- decreasing, t' [u) = a ^^^^ iog(p{u)t(iog u)) ) 
and s' (u) = a {s (log u)), then 

there is no DTISP (<' [u) , s' (u)) / (f — g) (log n)-natural property 
for partial density 6 useful against DTISP {t (u) ,s{u)) / f [n). 

Proof. Let T be a DT/S'P (f (u) , s' (u)) /(/- 5) (log n)-natural property for 
partial density 5. It is important to notice that all words in T have 
lengths of the form — 2". There exists S C F such that S g 
DTISP [t' [u] , s' {u)) / {f — g) (log N) and S has partial density Jolog. Suppose 
by contradiction that A = Sn (^U7Ve{2'.} [f {log N) , t (u) , s (u) 

is finite. Then S\ Ujve{2"} [f i^ogN) ,t{u),s (u) is still infinite 

with partial density (5olog and is still in DTISP {f (u) , s' {u)) / [f - g) (log TV), 
which contradicts proposition [51 Thus A is infinite, and there are infinitely 
many n's such that we can pick in this set an element L„ of length N — 2". 
Now by the Connection Lemma, the language L having these L„'s as charac- 
teristic words is in DTISP {t{u) ,s{u)) /f{n). Thus F is not useful against 
DTISP {t {u) ,s{u)) / f {n). □ 



4 Conclusion 



We had to take resource bounds on Kolmogorov-Loveland complexity with re- 
spect to the input in order to make a straightforward connection with the advice 
complexity classes. This led to use both n and u in the complexity classes of 
the form DTISP [t [u) , s (u)) // (n), and we had to make frequent and inele- 
gant conversions between n and u. To make things clearer, we suggest that in 
the advice complexity classes, resource bounds on (w, x) should be taken with 
respect to x only. This would not change the main classes P/poly and P/log. 

One may object that our results relativize. They do as do all diagonalization 
results, since our results are some kinds of diagonalizations. That is also the 
reason why we think that it would be surprising if one could do better than 
exhaustive search in our simulations. 

However we believe that it is important to exhibit separation results, even 
if they are simple. Indeed we want to re c all fo r example that in the deep 
proof that DLIN ^ NLIN of IPaul et al. (1983), the only separation result 
invoked is a simple time hierarchy on alternating Turing machines obtained by 
diagonalization. 
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